Dimensionality, internal consistency and interrater reliability of clinical performance ratings.
نویسندگان
چکیده
A total of 6444 ratings of the financial performance of 424 third- and fourth-year medical students were made by house officers and attending teachers during 12 separate internal medicine rotations. Ratings were based on 13 behaviourally anchored rating scales. One rating was randomly selected per student per evaluator type (house officer and attending teacher) during each of the 12 rotation periods. Ratings were factor analysed separately within each rotation period. Two factors emerged consistently, and congruence coefficients across the 12 occasions were high (0.88 or greater). The factors were labelled 'problem-solving (10 items) and 'interpersonal skills' (three items) on the basis of their content. Internal consistency coefficients of the indices constructed from items in the two factors and the total of the 13 items were high (0.9 or greater) and did not differ substantially when computed separately on the ratings from house officers and attending teachers. Interrater reliabilities on the individual items ranged from 0.14 to 0.33.
منابع مشابه
The Modified Scale for Suicidal Ideation: reliability and validity.
A modified version of the Scale for Suicidal Ideation was developed for use by paraprofessionals. The modifications included (a) addition of standardized prompt questions, (b) a standardized sequence of administration, (c) modification of the rating points to increase their specificity and range, (d) development of initial screening scores, and (e) selection of items for inclusion in the scale ...
متن کاملPsychometric properties of ADHD rating scales among children with mental retardation I: reliability.
The reliability of Attention-Deficit/Hyperactivity Disorder (ADHD) rating scales in children with mental retardation was assessed. Parents, teachers, and teaching assistants completed ADHD rating scales on 48 children aged 5-12 diagnosed with mental retardation. Measures included the Child Behavior Checklist (CBCL), Conners Rating Scales, the Attention-Deficit/Hyperactivity Disorder Test (ADHDT...
متن کاملThe reliability of the wolf motor function test for assessing upper extremity function after stroke.
OBJECTIVE To examine the reliability of the Wolf Motor Function Test (WMFT) for assessing upper extremity motor function in adults with hemiplegia. DESIGN Interrater and test-retest reliability. SETTING A clinical research laboratory at a university medical center. PATIENTS A sample of convenience of 24 subjects with chronic hemiplegia (onset >1yr), showing moderate motor impairment. IN...
متن کاملReliability: on the reproducibility of assessment data.
CONTEXT All assessment data, like other scientific experimental data, must be reproducible in order to be meaningfully interpreted. PURPOSE The purpose of this paper is to discuss applications of reliability to the most common assessment methods in medical education. Typical methods of estimating reliability are discussed intuitively and non-mathematically. SUMMARY Reliability refers to the...
متن کاملTriple jump examinations for dental student assessment.
The triple jump examination (TJE) attempts to assess a higher level of learning with demand for analysis, critical thinking, and resolution of problems presented by written scenarios based on patient care situations. The purpose of this study was to examine the internal consistency, scale reliability, and interrater reliability of the TJE used at the Ostrow School of Dentistry, University of So...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Medical education
دوره 21 2 شماره
صفحات -
تاریخ انتشار 1987